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ABSTRACT 

This  report  considers  an  efficient  method  for  utilizing 
the  redundancy  of  the  transmlttlhle  language  to  improve  the  relia¬ 
bility  of  a  digital  ccanunlcation  system  disturbed  by  additive 

non-white  gauss ian  noise.  Namely,  the  reliability  of  digital  sys- 

1  2 

terns  using  orthogonal  and  binary  digit  codes  *  1b  improved  by 
Introducing  an  uncertainty  region  at  the  receiver.  This  method 
Is  an  extension  and  generalization  of  null-zone  reception'*  pre¬ 
viously  applied  to  the  Improvement  of  binary  transmission  In  the 
presence  of  shite  gauss lan  or  peak-limited  noise.  It  Is  shown 
that,  by  permitting  a  small  percentage  of  nulls  to  be  printed, 
considerable  Improvement  in  reliability  Is  achieved.  In  addition. 

It  is  shown  that  ccanunlcation  links  using  orthogonal  digit  coding 
afford  greater  reliability  than  corresponding  links  usli%  binary 
digit  coding.  Performance  results  are  given  for  several  different 
codes  for  the  case  in  which  the  demodulated  gauss  ian  noise  power 
density  spectrum  Increases  with  lncreasli^  frequency.  Such  a 
noise  power  density  spectrin  acts  as  a  weighting  function  which 
confines  the  generated  signals  to  the  available  band  of  frequencies. 
A  geometric  Interpretation  of  the  results  is  given  In  terms  of  n- 
dlmenslonal  Euclidean  space.  Applications  to  feedback  systems 
will  be  discussed  In  a  future  report. 
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I.  BACKGROUND 


The  transmission  of  information  through  single  link  uni¬ 
directional  cc— unlcatlon  systems  requires  both  the  selection  of 
an  appropriate  set  of  signals,  {sj.(t)},  0  <  t  <  T,  and  the  design 
of  a  suitable  detection  process  at  the  receiver.  When  the  channel 
Interference  is  additive  white  gauss ian  noise  the  key  results  are: 

1.  The  optimum  receiver  should  use  correlation  techniques 
(or  the  equivalent)  in  which  the  received  signal  is  multiplied 
with  each  of  the  possible  signals  that  could  have  been  sent. 

The  product  signals  are  then  averaged  over  the  signal  duration. 
That  averaging  process  yielding  the  greatest  output  at  the  end  of 
the  signal  duration  indicates  which  signal  is  most  likely  to  have 
been  the  one  sent. 

2.  The  design  of  optimal  signals  of  average  power  S2  is 
based  on  the  distance  parameter 


Sj^fdt 


(1) 


0 

The  distance  parameter  Indicates  the  distingulshabillty  between 
pairs  of  the  signals  as  an  equivalent  amount  of  energy  per  message. 

3.  One  optimum  set  of  signals  can  be  constructed  as  follows: 
Under  an  average  power  constraint,  S2,  when  m  bits  of  in¬ 
formation  are  to  be  transmitted  in  the  time  T  with  the  least  error 
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probability,  a  basic  waveform  cpi(t)  of  duration  T/(2*  -  1)  is 
chosen,  subject  only  to  the  normalization  that  the  r.m.s.  value 
is  unity.  The  transmitted  signal  consists  of  strings  of  ±3cpi(t) . 
If  [+6<pi(t)  ]  denotes  a  one  and  [-Sq>i(t)  ]  denotes  a  zero,  the 
strings  resemble  in  structure  a  Sleplan  (2*  -  l,m)  group  code. 

At  the  receiver  correlation  detection  of  the  entire  string  is 
used. 

This  signal  structure  is  considered  an  equidistant  code 
because  the  distance  between  all  code  words  Is  the  same.  If  the 
equidistant  code  is  slightly  modified  by  permitting  small  ine¬ 
qualities  in  the  distances,  while  the  total  distance 

^*2  I  I  ^  '  (2) 

i=l  J-l 

remains  at  its  maximum,  then  either  the  transmission  rate  can  be 
increased  or  the  bandwidth  of  the  system  can  be  reduced  with  only 
a  small  Increase  in  the  error  probability.1 

An  alternate  procedure  is  to  select  a  set  of  ortbonamal 
waveforms  {%( t) }  each  of  which  is  of  duration  T.  The  optimum 
signals  are  then  of  the  form 
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2“-l 

si(t)  =  Yj  ei*s<*k(t)  (3) 

k=l 

in  which  e-Lfc  =  ±  1.  Note  that  this  is  a  parallel  transmission  of 
the  basic  waveforms  rather  than  a  sequential  transmission.  An 
optimum  signal  structure  again  resembles  a  Slepian  (2®  -  l,m) 
group  code  if  the  kth  orthogonal  waveform  is  identified  with  the 
kth  digit  and  the  corresponding  two  values  of  y  are  identified 
with  the  binary  digits.  The  optimum  distance  parameter  is 


when  m  bits  are  transmitted  in  the  time  T. 


When  the  interference  is  additive  gaussian,  but  not 
white  (i.e.,  the  noise  power  per  unit  bandwidth  is  not  the  same 
at  all  frequencies) ,  correlation  techniques  are  again  found  to  be 
optimum,  but  the  received  signal  is  correlated  not  with  the  possi¬ 
ble  message  signals,  but  with  modified  signals.  These  modified 
signals  are  obtained  from  the  characteristics  of  the  message  sig¬ 
nals  and  the  noise  power  spectrum.  The  form  of  these  modified 
signals  is  not  obvious,  although  the  results  obtained  for  specific 
cases  agree  with  intuitive  notions.  For  those  not  familiar  with 
this  background  material  a  brief  discussion  is  presented  in 
Appendix  A.  The  key  results  are  as  follows: 


k 


1.  The  optimum  receiver  should  use  correlation  techniques 
(or  the  equivalent)  In  which  the  received  signal,  y(t)  Is  corre¬ 


lated  vith  each  signal  of  the  set  (f^(t)}.  The  members  of  the 


set  have  a  one  to  one  correspondence  with  the  set  of  transmitted 
signals,  (sji(t)}  based  on  the  relation 

T 


Si(t) 


R(  t-T  )  f T  )  dT 


(5) 


0 


In  which 
farms  of 
2. 

Integral 


R(t)  Is  the  autocorrelation  function  of  the  noise.  Two 
the  optimum  receiver  are  shown  In  Figure  1. 

If  the  set  of  signals,  (s^t)},  satisfies  the  homogeneous 
equation 


oi2si(t) 


T 

■» 

Rft-Tjs^TjdT 

W 

0 


(6) 


f  j(t)  «  Sj_(t)  for  each  1,  as  In  the  case  In  which  the  interference 
Is  additive  white  noise.  This  set  of  signals,  which  Is  basic  to 
the  system,  will  be  designated  by  {cpjj(t)}. 

This  signal  set  has  two  important  properties.  First, 
the  set  Is  ccaqdete  and  orthonormal  so  that  any  reasonable  (finite 
mean  square  value,  finite  number  of  discontinuities)  set  of  signals 
lsl(t)}  can  be  expressed  as  linear  combinations  of  the  orthonormal 
set  £<Pjc(t) }  -  i.e.. 
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COMPARE  OUTPUTS 
>  AT  I NTERVALS  T 
APART 
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COMPARE  OUTPUTS 
AT  INTERVALS  T 
APART 


FIG.  / 

TWO  FORMS  OF  AN  OPTIMUM  RECEIVER  FOR  THE 
DETECTION  OF  KNOWN  SIGNALS  WHEN  THE  INTER¬ 
FERENCE  IS  ADDITIVE  (  WHITE  OR  COLORED) 
GAUSSIAN  NOISE. 
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oo 

Bi(t)  =  £  aik<Pk(t)  (7) 

k=l 


in  which 


*ik 


T 

%. 

0 


(8) 


Second,  for  any  set  of  signals  [sj[(t)},  if  the  received  signal  y(t) , 


y(t)  *  sj.(t)  +  n(t) 


(9) 


is  correlated  with  a  amber  of  the  orthogonal  set  cp^t) ,  the  mean 
output  is  ajv,  while  the  output  noise  is  additive  gausslan  of 
variance  cr^2  (<Jk2  being  eigenvalue  corresponding  to  the  k**  eigen** 
function  of  the  homogeneous  equation  (6)  ) . 

Any  signal  s^(t)  nay  thus  be  considered  as  consisting  of 
a  sum  of  orthogonal  signals  each  of  which  Is  Independently  affected 
by  the  additive  non-white  system  noise.  Bach  such  signal  or  digit 
nay  be  represented  by 

dii  -  »ik?ftc(t)  (10) 


The  magnitudes  of  the  weighting  constants  at  y  are  determined  from 
the  following  considerations * 

1.  To  minimize  interaction  between  the  signals  and  the  addi¬ 
tive  gausslan  noise  interference,  the  basic  waveforms  are  the 
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ordered  eigenfunctions  {cpk(t)}  selected  to  correspond  to  Increas¬ 
ing  eigenvalues,  {c^2},  starting  from  the  lowest,  until  as  many 
as  necessary  have  been  selected,  nils  is  because  the  lower  or¬ 
dered  eigenfunctions  correspond  to  more  distinguishable  waveforms 
(see  Appendix  A). 

2.  A  detection  scheme  is  desirable  which  does  not  require 
estimation  of  the  signal  or  noise  levels  at  the  receiver.  To 
achieve  this  all  digits,  aik  fear  all  1,  will  have  the  some 
magnitude  and  the  sign  of  the  magnitude  will  Indicate  the  digit. 

3.  Far  the  signal  structure  to  be  completely  synetrlcal  - 
i.e. ,  each  signal  to  have  the  some  noise  Immunity  as  any  other  - 
each  signal  of  the  set  (s^(t)}  will  be  chosen  to  have  the  same 
nunber,  u,  of  orthogonal  digits  and  the  power  will  be  apportioned 
among  the  digits  in  proportion  to  the  noises  {ofc2}.  Thus, 


aik  ■  ±  S 


J  k 


1,  2,  3#  • . . ,  u 


(11) 


The  signs  of  the  digits  are  found  from  a  suitable  binary  group 
1  4 

alphabet.  ’ 

For  such  an  orthogonal  digit  coding  scheme  the  probability 
that  s^t)  will  be  received  as  Sj(t)  excluding  all  the  other  sig¬ 


nals  is  given  by 
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PU 


in  which. 


Kx) 


is  the  tabulated  error  Integral  and 


(12) 


(13) 


- 1  cw 

k-1  CTk 

The  value  of  5-j_jk  is  zero  If  the  signs  of  the  orthogonal  digits 
d^,  djk  are  the  sane  and  unity  if  the  signs  are  different. 

As  can  he  seen  the  larger  the  snaller  the  detection 
error,  Pjj  .  For  this  reason  will  he  called  the  separation 
function. 


Several  types  of  signal  structures  will  he  considered 
in  this  report.  These  structures  will  he  United  to  those  havli^ 
the  properties  described  in  paragraphs  1,  2,  and  3  above.  The 
analogy  between  these  types  of  signal  structures  and  coding  is 
quite  apparent.  The  oaber  of  orthogonal  vaveforas  (q^t)} 
selected  corresponds  to  the  selection  of  the  xuaber  of  digits  in 
each  code  word.  The  selection  of  the  signs  of  the  orthogonal 
digits  corresponds  to  the  selection  of  the  binary  digits  of  a 


9 


conventional  code.  For  convenience  any  signal  structure  havlig 
these  properties  will  be  called  an  efficient  code.  The  efficient 
codes  considered  In  this  report  are 

1.  Minimax  codes 

2.  Equal  separation  codes. 

Mining*  Codes 

The  minima*  code  Is  an  efficient  code  the  signal  struc¬ 
ture  of  which  resembles  uncoded  PCM.  A  minimum  number  of  ortho¬ 
gonal  waveforms  Is  used,  just  as  PCM  employs  a  minimum  number  of 
digits  per  code  word.  The  signal  power  Is  apportioned  among  the 
orthogonal  digits  so  as  to  minimize  the  maxima  probability  that 
any  transmitted  code  word  will  be  received  as  another.  If  m  bits 
of  Information  are  to  be  transmitted,  the  minimum  number  of  ortho¬ 
gonal  digits  In  each  signal  is  m.  The  maximum  detection  error 
occurs  for  any  two  signals  s*(t)  and  sj(t)  when  they  differ  by 
one  orthogonal  digit.  Since  this  error  is  to  be  minimized  sub¬ 
ject  to  average  power  limitation  of  the  signal,  it  means  that 
every  digit  of  any  signal  sj,(t)  must  be  affected  by  the  noise  In 
the  same  manner,  or  for  any  Si(t)  of  the  signal  set  (s^Ct)}  , 

1  si,  2,  . . . ,  2°  the  following  condition  must  be  satisfied. 

an  aim  a^  aj* 

—  ■  ss  ■  ■  ■  S  •••  SS  —  ■  —  ■  ■  s  •  •  •  ts  •  —  ■■■ 

°2  &n 


(15) 
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This  1 b,  of  course,  one  of  the  properties  the  code  oust  ham  to 
be  an  efficient  code. 

The  error  probability  of  the  alnlwax  code  Is  given  by 

Pe  -  1  -  (16) 

In  which 

^-H1 -•(-&)]  (17) 

and  gf  Is  the  separation  function  between  two  code  words  that 
differ  by  one  digit  -  i.e. , 

S?  «  — ^ -  (18) 

k=l 


laaal  Separation  Codes 

The  equal  separation  codes  are  those  for  which  all  the 
separation  functions  are  e<&ial  and  the  total  separation 

i  2» 

*t-i  Z  l  &  <« 

i=i  J=i 

i/j 

Is  at  its  aaiiiei.  A  code  defined  In  this  wanner  determines  a 
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stationary  point  far  the  error  probability  and.  is  thus  an  optimum 
code. 

It  can  be  shown  that  the  signal  structure  resembles  a 
Slepian  (2®  -  1,  m)  group  code.  The  wards  of  this  type  of  code 
are  equidistant  from  each  other. 

The  separation  function  is 


2*"1  S^T 


I 


k-1 


(20) 


The  corresponding  expression  far  the  error  probability,  Pe,  is 


Pe<l 


-  (1  -  P8) 


2*-l 


(21) 


in  which 


it 


If  the  error  probability  is  small,  an  approximate  expression  is 

Pe  4  (2“-l)Ps  (22) 


in  which 
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For  purposes  of  illustration  the  specific  case  considered 
in  this  report  is  that  in  which  the  Interference  is  non-white 
gauss lan  noise,  the  spectral  density  of  which  is 

Wn(a>)  =  t?  +  B 2a?  (double-sided  spectrum)  (23) 


ibis  can  be  considered  either  the  noise  at  baseband  corresponding 
to  the  synchronous  detection  of  an  r-f  signal,  ocr  as  a  "weighting 
function"  which  results  in  the  design  of  signals  such  that  these 
signals  are  confined  to  an  available  frequency  band.  In  this 
latter  Interpretation  the  signal  set  (s^ft)}  is  designed  to  mini¬ 
mize  interchannel  interference.  The  autocorrelation  function  cor¬ 
responding  to  the  power  density  spectrum  of  the  noise  is  given  by 


R(t) 


+CD 

[A2  +  B2**]  e^  do 
-oo 


(24) 


-  A26(t)  -  bV(t) 


in  which 


S(t)  b  Dirac-  delta  function 

6"(t) =  Second  derivative  of  the  Dirac  delta  function. 
The  basic  orthonormal  functions  <p^(t)  are  solutions  of 
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Ofc^t) 


T 

> 

^(r)R(t-T)dT 

V 

0 


(25) 


By  substitution  it  is  found  that  the  functions  <p^(t)  are  therefore 
solutions  of  the  differential  equation 


B^Pfc"(t)  +  (oj2  -  A2)<p^(t)  =  0  (26) 

To  avoid  discontinuities  in  sequences  of  transmitted 
signals  the  additional  constraint 

«Pk(0)  -  q^T)  =  0  (27) 

will  be  imposed.  The  corresponding  orthonormal  set  is  then 


^(t)  m*j- §-  8in 


fact 

T 


(28) 


in  which  k  ■  1,  2,  5,  ...  .  Since 


/  Ok*  -A* 


the  corresponding  eigenvalues  are 


(29) 


T2 


+  A2 


(50) 


lfc 


The  orthogonal  components  of  the  signals  are  the  Fourier 
Series  components.  Bote,  however,  that  the  associated  variances 
Co*2}  Increase  with  Increasing  k.  This  is  reflected  In  the  fact 
that  higher  order  components  are  more  heavily  weighted  before 
being  stmmed  to  form  the  signals.  See  reference  2  for  specific 
signal  waveforms. 
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II.  UNCERTAHCT  REGION  RECHTICH 


In  many  practical  situations,  the  transmitted  language 
possesses  redundancy  and  thus  can  tolerate  the  printing  out  of 
same  "nulls"  -  a  null  corresponding  to  none  of  the  possible 
transmitted  signals  being  selected  as  the  most  probable  signal 
sent.  This  selection  may  be  desirable  if  the  noise  conditions 
in  the  channel  are  such  that  the  two  greatest  p[s^(t) /y(t) ]  are 
close  to  each  other.  In  these  cases,  the  amount  of  information 
destroyed  by  withholding  the  decision  -  i.e. ,  selecting  the 
nun  -  may  be  less  than  that  destroyed  by  selecting  the  most 
likely  signal  as  the  signal  sent.  If  the  language  does  not  per¬ 
mit  the  presence  of  nulls  in  the  final  message,  these  may  be 

*5670 

filled  in  by  means  of  feedback  systems  discussed  elsewhere. ’  '* 

Indeed  the  use  of  nulls  itself  is  a  useful  means  of  obtaining  the 

9  10 

advantages  of  feedback,  particularly  the  fail-safe  operation. 

Thus,  the  reliability  of  the  transmission  can  be  improved 
if  instead  of  accepting  the  signal  corresponding  to  the  largest 
posterior  probability  p[ai(t)/y(t)],  the  decision  is  withheld  for 
any  two  signals  s^t),  sj(t)  of  the  transmittible  set,  {sj/t)}, 
if 


1  p[sj(t)/y(t)]  < 

T]  ~  p[sj(t)/y(t)]  “ 


(31) 


1 6 


in  which  1]  determines  the  "width'1  of  the  uncertainly  region.  The 
value  of  'll  controls  the  percentage  of  nulls  present  In  the  accepted 
message. 

One  can  vary  the  width  of  the  uncertainly  region,  71,  to 
match  the  noise  conditions  In  the  channel.  However,  when  the  inter¬ 
ference  is  additive  Gaussian  with  Rayleigh  fading,  the  receiver  be¬ 
comes  complicated  with  only  a  small,  increase  In  reliability.  Cxus, 
in  practical  situations  the  use  of  a  variable  width  is  not  usually 
justified.  However,  If  the  interference  is  a  linear  combination 
of  Gaussian  and  other  fonts  of  noise,  the  use  of  a  variable  width 
together  with  a  nonlinear  detection  scheme  may  yield  considerable 
improvement  In  comparison  with  fixed  width  systems.  Shis  will  be 
discussed  in  a  forthcoming  report. 

The  performance  of  the  uncertainty  region  reception  system 
may  be  characterized  by  two  error  probabilities  and  two  null  prob¬ 
abilities.  These  are: 

1.  Binary  Detection  Error 

2.  Binary  Hull  Probability 
3-  System  Error  Probability 
4.  System  Hull  Probability 

Die  binary  detection  error  and  the  binary  null  probability  are  eval¬ 
uated  by  considering  only  pairs  of  signals  -  the  true  one  and  one 
other  -  and  ignoring  all  others.  The  binary  detection  error  is  then 
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the  probability  that  the  true  signal  will  have  a  smaller  a  posteriori 
probability  than  the  other  signal,  while  the  binary  null  probability 
is  the  probability  that  the  a  posteriori  probabilities  will  be  too 
close  for  a  good  decision.  Bote  that  if  there  are  n  signals,  there 
are  possible  different  binary  detection  errors  and  binary 

null  probabilities.  The  system  error  probability  and  the  system 
null  probability  are  the  usual  overall  system  parameters. 

To  evaluate  the  bounds  of  the  uncertainty  region  and  the 
above  parameters,  consider  that  the  received  signal  y(t)  is  properly 
correlated  with  each  member  of  the  signal  set  {f^(t)]  to  yield  the 
set  of  stochastic  variables  upon  which  the  decisions  are  based.  If 
the  received  signal  is  expanded  in  the  form 


u 

y(t)  =  £  yk  <pk(t) 
fc=l 


in  which 


y*  = 


y(t)  «pk(t)  dt 


the  set  of  stochastic  variables  is  given  by 


(32) 


(33) 


w. 

{I 

k=l 


yk  »lk 
_a 


} 


i  -  1>2, 


(34) 


lfl 


Die  more  likely  signals  correspond  to  larger  values  of  the 
stochastic  variables.  Moreover,  the  a  posteriori  probabilities 
are  exponentially  related,  to  the  variables  so  that  -the  bounds  of 
the  uncertainty  region  are  given  by 

-kx  <  £  y*(aHt  ' :  <  ki  (35) 

k=l  ‘k 

for  all  l,i,  In  which  kx  =  In  T).  This  is  a  generalization  of 
previous  work?  based  on  the  Interference  being  white  noise  to  the 
case  In  which  the  noise  Is  non-white  and  orthogonal  digit  coding 
is  used. 

To  evaluate  the  binary  detection  error  probability  Pij 
the  a  posteriori  probability  of  the  true  signal  sj^t)  is  coopered 
with  that  of  the  signal  sj(t).  Bo  do  this  consider  the  stochastic 
variable 


Tij  “ 


u 


l 

k=l 


yk(lk  -  »Jk) 

4 


(36) 


Since  ail  y^  have  a  Gaussian  distribution  and  a^y,  ajj^  and 
are  fixed  numbers,  each  term  of  the  sum  Is  Gaussian  and  thus  the 
stochastic  variable  v^j  has  a  Gaussian  distribution.  Bo  specify 
the  probability  density  distribution,-  P(v^j ) ,  It  is  therefore 
sufficient  to  specify  the  mean  value,  Vj_j,  and  the  variance,  ojj. 


19 


As  shewn  In  Appendix  A,  the  use  of  the  orthonomal  expansion  re¬ 
sults  in  each  tern  of  this  sum.  being  a  variate  which  is  indepen¬ 
dent  of  the  other  tens.  Thus,  the  mean  value  is  the  sin  of  the 
mean  values  of  each  ten,  while  the  variance  is  the  sun  of  the 
variances. 

Since  s^(t)  is  the  signal  sent,  the  mean  value  is 


u 


k=l 


ajk(aifc  -  ajt) 

4 


(37) 


The  variance  is 


The  binary  detection  error  is  then  given  by 


(38) 


(39) 


in  which 


and 


m 
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Die  function  kj j,  vhich  defines  the  uncertainty  region  in  the 
orthogonal  signal  coordinates,  will  be  called  the  uncertainty 
function. 

When  efficient  coding  is  used. 


and 


< 


-  4 


l 

k=l 


(41) 


(42) 


in  vhich  6i(jk  is  zero  if  the  signs  of  the  orthogonal  digits  aik, 
ajk  are  the  sane  and  unity  if  the  signs  differ.  The  correspond¬ 
ing  expression  for  the  separation  and  uncertainty  functions  are 


&  ■  »  ***■  <«> 

£  ®ijk  <4 

k=l 


and 


(44) 


in  vhich 


X  = 


I  8iJ* 


k=l 


(45) 
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Die  binary  null  probability,  u^j,  is  the  probability  that 
having  sent  signal  s^(t),  the  received  signal  will  be  In  the  null 
region  so  far  as  s^{t)  and  Sj(t)  are  concerned. 

-  -f- [ » (  ^ klJ  )-»(  %  ^  )3  <*> 

It  is  clear  from  this  equation  vby  kfj  Is  called  the  uncertainty 
function;  large  values  of  k^j  Imply  large  values  of  ujj. 

An  exact  expression  for  the  error  probability  of  the  sys¬ 
tem  depends  an  the  exact  signal  structure  used  since  the  values  of 
P-jj  are  not  Independent.  However,  using  the  same  procedure  as  In 
[1],  a  pessimistic  expression  for  the  error  probability  is  obtained. 

2®  2® 

pe<i-  2-»  X  TT(1_  pij)  (vr) 

i=i  j=i 

i  4  J 

Die  corresponding  system  null  probability,  uo,  that  the 
decision  will  be  withheld  after  all  comparisons  have  been  made 
similarly  depends  on  the  exact  signal  structure.  As  an  approxima¬ 
tion, 

"o  <  Uij],,^  W 

In  which  [un ]MT  is  the  maximum  value  of  uij  for  all  1, j. 
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In  addition  to  the  above  efficient  codes,  conventional 
binary  digit  codes  vlll  also  be  considered.  In  these  codes,  the 
signals  consist  of  strings  of  plus  or  minus  the  basic  waveform 
«pi(t)  -  l.e. ,  the  first  eigenfunction  of  the  homogeneous  integral 
equation  based  on  the  signal  duration  .  For  a  total  signal 
duration  T  and  u  binary  digits  per  code  word. 


*1 


(49) 


The  corresponding  separation  function  for  these  codes  is 


=  <*» 

UTj 

In  terms  of  this  separation  function,  the  above  relations  for  the 
error  probabilities  and  null  probabilities  remain  unchanged  If  the 
noise  In  each  digit  duration  is  assumed  uncorrelated  vlth  the  noise 
In  other  digit  durations. 
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III.  BINARY  SYSTEM 

Consider  the  simplest,  but  very  important  case,  of  binary 
communication  in  which  there  core  only  two  possible  transmittible 
signals  (m  =  l).  In  this  case,  the  choice  of  signals  is 
si(t)  =  -s3(t)  =  S  */t  cpi(t),  in  which  <pi(t)  is  the  normalized 
first  eigenfunction  of  the  homogeneous  integral  equation.  Dae  sys¬ 
tem  error  probability  is 

p.  =  -Pai  =  ^-[l-  erf  (-Lp-)]  (51) 

in  which 

f  =  ^ 

fri3 

and 

k?  =  - 

Die  expression  for  the  null  probability  reduces  to 

erf(-5jrO]  <52) 

When  the  bounds  on  the  uncertainty  region  are  set  in  ac¬ 
cordance  with  a  fixed  a  posteriori  probability  -  i.e. ,  fixed  - 
the  error  probability  attains  a  maximum  when 


(52) 

(53) 


is  a  minimum.  This  critical  setting  of  the  uncertainty  parameter, 
k(.,  is  given  by 

*c  =  2?  (55) 


For  proper  operation  of  the  system  (high  reliability  and  low  per¬ 
centage  of  nulls)  the  uncertainty  parameter  Bhould  be  in  the  range 

0  <  ki  <  kc  (5 6) 


For  convenience  let  us  define  a  normalized  uncertainty  parameter 


a  =  -2Sl_  (57) 

kc 

Then 

ert  [-l-Uta)  ]}  (58) 

and 

u°'-Herf  [^-(i+o,]-err[^-(i-o)]}(59> 

in  which  the  proper  range  of  operation  is 

0  <  a  <  1  (60) 


Figure  2  shows  the  behavior  of  the  system  error  probability  and 


SYSTEM  ERROR  PROBABILITY, 
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FIG.  2 


BINARY  SYSTEM  ERROR  PROBABILITY  AND 
NULL  PROBABILITY  ASA  FUNCTION  OF  THE 
UNCERTAINTY  LEVEL,  a 


SYSTEM  NULL  PROBABILI 


26 


the  null  probability  Uq  u  &  function  of  the  normalized  uncer¬ 
tainty  parameter,  a,  tar  fixed  values  of  the  separation  function, 
5*.  Cbe  can  conclude  from  the  figure  that  for  large  values  of  the 
separation  function  the  system  error  probability,  *e,  decreases 
almost  exponentially  with  an  increasing  null  threshold,  a,  while 
the  system  null  probability,  uo,  increases  only  linearly,  for 
reasonable  large  values  of  the  separation  function,  5*,  and  far 
operation  near  the  minimum  error  probability,  a  «  1,  suitable  ap¬ 
proximations  are 


1 

7ST 


!(1«) 


m 


art 


“o  -  {  1  -  }  <&> 


These  equations  indicate  that  far  values  of  the  normalised  uncer¬ 
tainty  parameter  close  to  unity  and  for  large  values  of  the 
separation  function,  small  changes  in  P  result  in  a  considerable 
improvement  in  the  reliability  of  the  coswunl cation  system  while 
the  increase  in  the  percentage  of  nulls  is  negligible. 

To  relate  these  results  to  the  noise  in  the  system  con¬ 
sider  the  caae  in  which  the  demodulated  noise  power  spectrua  Is 
such  that  the  noise  density  increases  with  increasing  frequency. 
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Ihe  Importance  of  this  caae  is  discussed  in  Section  I.  Figures 
3  and  4  sh ow  the  behavior  of  the  system  for  noise  power  density 
spectra 

(1  +  0.1  a?)  and  (l  +  O.Olo?) 

respectively,  and  for  a  fixed  null  level  a  =  0. 5.  For  tooth  cases 
best  operation  occurs  when  the  separation  is  large  (large  average 
power,  SP,  long  signal  duration,  T)  since  a  great  decrease  in 
error  probability  is  then  obtained  at  the  coat  of  only  a  modest 
percentage  of  nulls.  However,  note  that  the  more  non- white  the 
noise,  the  more  effective  is  an  increase  in  signal  duration  over 
a  corresponding  increase  in  signal  power.  Ibis  is  in  contrast  to 
the  situation  in  which  the  interference  is  white,  since  then 
doubling  the  duration  is  just  as  effective  as  doubling  the  power. 
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SIGNAL  DURATION, T 

FIG.  3 

BINARY  SYSTEM  ERROR  PROBABILITY  AND 
NULL  PROBABILITY  AS  A  FUNCTION  OF  DE 
CIS  I  ON  TIME 


SYSTEM  NULL  PROBABILITY, 


SYSTEM  ERROR  PROBABILITY, 
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FIG.  4 

BINARY  SYSTEM  ERROR  PROBABILITY  AND 
NULL  PROBABILITY  AS  A  FUNCTION  OF  DE¬ 
CISION  TIME 


SYSTEM  NULL  PROBABILITY 
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IV.  HJLTISIfflUL  SX9XM 

It  has  previously  been  shcwn^  that  transmission  of  a  mes¬ 
sage  of  m  bits  can  be  near  optimally  achieved  by  coding  It  as  one 
signal  of  a  properly  generated  time- Halted  signal  set,  (si(t)}, 

1  =  1,2,3 ,  ...,  2*,  using  orthogonal  or  binary  digit  representa¬ 
tions  corresponding  to  orthogonal  or  binary  digit  codes.  A  brief 
summary  of  previous  results  Is  given  in  Section  I.  As  has  been 
demonstrated,  the  key  parameters  far  these  types  of  codes  are  the 
separation  functions  given  in  Equations  (43)  and  (JO).  When  un¬ 
certainty  region  reception  Is  Introduced  at  the  receiver,  the  un¬ 
certainty  function  becomes  another  key  parameter.  Relation  (k4) 
defines  the  uncertainty  function  In  orthogonal  signal  coordinates. 
The  purpose  of  this  section  of  the  report  is  to  obtain  general  ex¬ 
pressions  for  the  performances  of  the  nultlsignal  systems  in  terns 
of  these  parameters,  and  the  evaluate  specific  cases  which  permit 
an  engineering  comparison  of  the  relative  merits. 

A.  General  Relations 

One  can  Introduce  the  concept  of  a  critical  value  of  the 
uncertainty  parameter  for  these  codes  In.  a  manner  similar  to  that 
for  binary  case  -  namely,  it  will  be  defined  as  that  value  of  the 
uncertainty  parameter  corresponding  to  the  marl  saw  detection  error. 


Using  standard,  methods,  this  critical  value  Is  found  to  be 
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kcij  =  (63) 

normalizing  with  respect  to  this  critical  value 

Q ij  =  ~ 1 —  (64) 

^ij 

the  expression  for  the  binary  detection  error  probability  becomes 

|5lJ<VI ]}  <65> 

Die  corresponding  expression  for  the  binary  null  probability  is 


Bote  that  §ij  and  aij  depend  an  the  separation  between  the  two 
signals  being  considered.  Tor  two  particular  signals,  if  the 
null  level,  kj,  is  fixed  then  {a^}  are  fixed.  Systeas  using 
variable  kx  -will  be  discussed  in  connection  with  receiver  inple- 
nentation  problems.  The  proper  range  of  operation  is,  of  course, 

0  <  Oij  <  1 

As  might  be  expected  from  an  examination  of  the  non- 
uncertainty  region  systeas,  an  exact  expression  for  the  system 
error  probability  is  difficult  to  obtain  because  the  values  of 
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Pj_j  are  not  Independent.  Using  the  procedure  of  [l]  a  pessimistic 
expression  can  be  obtained  for  the  cases  In  which  orthogonal  digit 
coding  Is  used.  Let  7^  be  the  number  of  code  words  of  weight  co. 
Defining 


and 


4- 


utfT 


k=l 


(67) 


- -i- [ 1  -  (68) 

then 

Pe  <  1  -  n  U  -  *o>)7a)  (69) 

<0*0 

A  corresponding  pessimistic  expression  for  the  system  null  prob¬ 
ability  Is 

u 0  <  [t4..i  3^  (70) 

(71) 

In  which 

W  “  5o>| _ 

(72) 

§min  =  §a|^<n  >  as  f  0 
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and 

Omx  =  £*ij  ,  all  t,j  I  /  j 

B.  Ocparlson  gg  Perfnrmanr  > 

Die  performances  of  systems  using  the  Mini— or,  equal 
separation,  and  equidistant  codes  will  he  evaluated  under  the 
aasiwqrtlan  that  the  additive  colored  noise  in  the  system  has  a 
deaodulated  power  density  spectrum  which  is  an  increasing  func¬ 
tion  of  frequency,  is  previously  shorn,1  with  the  detector 
selecting  the  signal  corresponding  to  the  largest  posterior 
probability  p(»i/y),  the  orthogonal  digit  codes  yield  lower 
probabilities  of  error  than  Unary  codes,  all  other  conditions 

With  a  noise  power  density  spectrua  as  given  by  relation 
(23),  adjustment  of  the  ratio  B/A  corresponds  to  adjusting  the 
affective  bandwidth  of  the  signals.  Bhen  B/A  is  snail,  the  noise 
is  closer  to  being  white  noise  and  the  signals  designed  will  have 
a  greater  bandwidth.  Vhen  B/A  is  large,  the  noise  is  heavily 
colored  and  the  designed  signals  will  have  a  narrow  bandwidth. 

If  the  bandwidth  of  the  system  is  large,  it  is  better  to  use 
■ore  explicated  signal  forms  (i.e.,  the  equal  separation  code). 
On  the  other  hand,  if  the  bandwidth  of  the  system  is  small,  the 
use  of  the  minima*  code  la  indicated.  She  reason  for  this  la 
that  the  higher  ordered  eigenfunctions  from  which  the  higher 
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ordered  digits  are  generated  have  greater  noise  associated  with 
them.  The  specific  variances  are  given  by  relation  (30).  Wien 
the  noise  Is  highly  colored,  the  noise  Increases  elans t  with  the 
square  of  the  order  of  the  digit,  so  that  It  Is  better  to  use 
fewer  digits  -  l.e. ,  the  atniawx  code.  On  the  other  hand,  when 
■ore  digits  can  be  used,  the  equal  separation  code  Is  better. 

To  evaluate  the  perforaace  of  uncertainty  region  recep¬ 
tion  systems  using  the  ainlaaar,  equal  separation,  and  equidistant 
codes  described  above,  specific  relations  for  error  probability 
and  null  probability  will  now  be  derived. 

1.  Mlniaar  Codes 

The  alnlaav  code  Is  the  orthogonal  digit  analog  of 
uncoded  binary  PCM.  The  structure  of  the  code  Is  such  that  the 
aariwai  detection  error  Is  el ni sized-  Ihe  separation  functions 
for  this  cade  are  not  all  the  same,  but  Instead  resemble  the 
distances  between  uncoded  binary  words.  Corresponding  to  the 
error  probability  of  the  a  bit  code,  given  by  (l6),  (17),  and 
(18)  for  norsstl  reception,  the  error  probability  for  uncertainty 
region  reception  is  given  by 

Pe  -  1  -  (1  -  Pi  TF  (73) 


in  which 
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FIG .  5 

PERFORMANCE  OF  THE  MINIMAX  CODES,  WHEN  THE 
NOISE  POWER  DENSITY  SPECTRUM  I S  ( I  +  O.OI  w2). 


SYSTEM  NULL  PROBABILITY, 
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FIG.  6 


PERFORMANCE  OF  THE  MINIMAX  COOES, WHEN  THE 
NOISE  POWER  OENSITY  SPECTRUM  IS  (  I +O.OOOI  w*) 
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and 


l  °5 


m 


2SP& 


(75) 


(76) 


A  pessimistic  expression  for  the  mill  probability  is 

(77) 

These  relationships  are  plotted  In  figures  5  and  6  for  the  case  In 
which  the  noise  power  density  spectrum  Is  (l  +  0.01  aP)  and 
(1  +  0.0001  ao* )  respectively.  Both  the  two  bite  per  code  word  and 
the  three  bits  per  code  are  shown,  each  for  two  values  of  signal  power. 
These  curves  correspond  to  holding  ct^  constant  at  0.5.  Comparisons 
of  the  performance  of  the  mini, max  code  with  the  other  codes  are 
given  at  the  conclusion  of  this  section. 

2.  Equal  Separation  Codes 

The  equal  .separation  code  is  an  orthogonal  digit 
code  with  all  spearatlon  functions  equal  and  the  sum  of  these 
separation  functions  as  large  as  possible.  For  this  code  the 
separation  function  is 


SYSTEM  ERROR  PROBABILITY, 


SYSTEM  NULL  PROBABILITY 


SYSTEM  ERROR  PROBABILITY 
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THE  NOISE  POWER  DENSITY  SPECTRUM  IS  ( I  +O.OOOI  «*  ). 


SYSTEM  NULL  PROBABILITY 
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a  - 

a«-i 

Z* 

k*l 


(78) 


"  “H  i  *  «**  [ <1  ♦  <*>  ]  }  <80) 

and 

Pe  <  1  -  (1  -  Pb)2""1  (61) 

The  pessimistic  expression  for  the  null  probability  reduces  to 

*  -§-  {  “*  [  -fc (1  *  °  >  ]  -  “*  [  (1  -  °  >  ] }  (82> 

These  relations  are  shown  in  Figures  7  and  8  for  the  same 
conditions  as  previously  given  for  the  mlntnwx  code.  Comparisons 
with  other  codes  are  made  at  the  end  of  this  section. 

3.  Equidistant  Codes 

The  equidistant  code  is  the  binary  digit  analog  of 
the  equal  separation  code.  For  this  code  the  separation  function 
is 
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FIG.  9 


PERFORMANCE  OF  THE  EQUIDISTANT  CODES  WHEN 
THE  NOISE  POWER  DENSITY  SPECTRUM  IS  ( I  +  O.OI  cu2) 


SYSTEM  NULL  PROBABILITY 


SYSTEM  ERROR  PROBABILITY 
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1.0  2.0 
SIGNAL  DURATION, T 


FIG.  10 

PERFORMANCE  OF  THE  EQUIDISTANT  CODES  WHEN 
THE  NOISE  POWER  DENSITY  SPECTRUM  IS ( I  +0.0001  «*) 


SYSTEM  NULL  PROBABILITY 


^3 


$  -  (83) 

(2*-l)  T? 

In  which 

t?  =  +  ka  (04) 

r 

and 

*  *  ^  («> 

In  terras  of  these  parameters,  the  expressions  for  the  system  error 
probability  and  system  null  probability  are  analogous  to  those  for 
the  equal  separation  codes  If  $0  is  replaced  by  5d  and  c%  by  a&. 
Figures  9  and  10  show  the  performance  of  this  code  for  the  same 
conditions  as  the  other  codes  shown  In  Figures  5  to  8. 
k.  Comparisons 

Figures  5  to  10  illustrate  the  performances  of  the 
mini max,  equal  separation,  and  equidistant  codes  when  the  inter¬ 
ference  is  additive  colored  noise.  Two  specific  noise  power 
density  spectra  are  considered  (1  +  0.01  a?)  and  (l  +  0.0001  a?) 
respectively.  For  each  code  the  two  bits  per  code  word  and  the 
three  bits  per  code  word  cases  are  shown,  each  for  two  values  of 
signal  power.  The  normalised  null  level  Is  held  fixed  at  0. 5- 

As  can  be  seen  from  the  figures,  for  high  Information  rate 


and  a  noise  power  density  spectrua  that  is  far  from  white  (this 


corresponds  to  designing  signals  for  a  narrow  bandwidth  con-iml  ca¬ 
tion  system),  the  mini  mux  code  performs  best.  For  low  information 
rate  and  a  nearly  white  noise  power  density  spectrum,  the  equal 
separation  code  is  better. 

In  general,  increasing  the  signal  duration  results  in  a 
much  greater  decrease  in  both  the  error  and  null  probabilities  than 
does  Increases  in  average  power.  This  effect  is  particularly  pro¬ 
nounced  so  far  as  the  error  probability  is  concerned  if  the  uncer¬ 
tainty  region  is  small. 

Comparison  of  the  equal  separation  code  with  the  equidis¬ 
tant  code  shows  the  superiority  of  the  former.  Ms  behavior  may 
be  generalized  by  coshering  any  given  orthogonal  digit  code  with 
its  binary  digit  analog.  In  both  cases  the  error  probability  and 
the  null  probability  axe  the  same  functions  of  the  corresponding 
separation  and  uncertainty  parameters.  However,  the  uncertainly 
parameters  are  the  same  but  the  separation  functions  differ.  For 
fixed  values  of  the  system  parameters,  the  separation  function  of 
the  orthogonal  digit  code  is  always  larger  than  the  separation 
function  of  the  corresponding  binary  digit  code.  Thus,  for  the  same 
average  power  and  noise  conditions,  a  communication  link  using 
orthogonal  digit  coding  is  operating  at  an  effectively  greater 
signal- to- noise  ratio  than  if  a  binary  digit  code  were  used. 
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Y.  SYSTEM  iesicar 

To  select  the  proper  signal ling  alphabet  for  &  given 
conn!  cation  link,  &  flexible  nethod  of  signal  design  Is  needed. 
Such  a  nethod,  based  on  the  utilisation  of  a  digital  conputer  Is 
considered  below.  This  Is  followed  by  a  discussion  of  various 
techniques  for  lnpleuentlng  an  uncertainty- region-reception, 
orthogonal- digit-code  receiver. 

A.  Signal  Design 

By  neans  of  a  general  purpose  digital  computer,  one  can 
select  a  near  optima*  choice  of  transnlttlble  signals  for  a  set 
of  given  design  restrictions.  Tb  Illustrate  the  technique  con¬ 
sider  a  case  In  vhlch  the  constraints  on  the  design  are  the  infor¬ 
mation  rate  In  bits  per  second,  average  power,  noise  level  In  the 
channel,  and  the  bandwidth.  Che  bandwidth  constraint  Is  trans¬ 
ferable  Into  the  choice  of  a  noise  power  density  spectra  —  l.e. , 
Into  the  selection  of  b  based  on  the  weighting  function  (l  +  bso^ ). 
In  tens  of  the  absolute  level  (A*  +  the  noise  level  of 

the  channel  gives  the  value  of  A?,  while  the  bandwidth  constraint, 
b,  gives  the  ratio  B/A.  Specifying  both  channel  parameter*  hence 
determines  both  A  and  B. 

The  Iterative  process  Is  started  by  selecting  a  value  for 
the  signal  duration,  T,  such  that  4*T/b  la  well  above  the  Hyquiat 
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rate.  Several  block  codes  are  then  generated  by  the  computer, 
experience  Indicating  that  about  60  percent  of  the  digits  should 
be  information  digits  and  the  rest  parity  check  digits.  The  num¬ 
ber  of  Information  digits  selected  vill  be  based  on  the  specified 
data  rate  and  the  duration  of  the  signals.  Those  codes  haring  the 
greatest  Faming  distances  are  selected  for  further  processing. 

Keen  these  code  structures  the  corresponding  separation  functions 
are  evaluated.  This  permits  the  evaluation  of  the  performance  of 
the  codes  vhen  uncertainty  reception  is  not  used.  From  a  specifi¬ 
cation  on  the  percentage  of  nulls  permitted,  the  corresponding 
reliability  —  i.  e.  ,  error  probabilities  —  can  be  determined. 

The  code  vlth  the  minimum  error  probability  Is  tentatively  selected 
as  the  best.  If  this  performance  is  satisfying,  this  code  repre- 
sents  a  suitable  solution.  If  not,  or  if  a  near  optimum  solution 
Is  desired,  the  process  is  repeated  vlth  other  codes  at  other 
values  of  signal  duration. 

Since  there  Is  no  strictly  deterministic  procedure  for 
evaluating  vhen  the  optimum  solution  Is  reached.  It  Is  possible 
to  find  that  the  specifications  cannot  be  satisfied  vlth  In  a 
reasonable  computation  time.  As  a  practical  solution,  the  speci¬ 
fications  should  probably  be  relaxed,  as  they  may  be  Impossible 
to  satisfy-.  'When  a  code  vlth  the  desired  specifications  Is  found, 
the  corresponding  signal  set  (s^(t)}  may  be  formally  found  by  the 


itrix  operation*. 


G  -Md£  «*> 

In  which  the  elements  of  the  column  aatrix  ©  are  the  sabers  of 
the  signal  set.  771  is  the  Matrix  corresponding  to  selected  binary 
block  code  digits  vith  0  replaced  by  -1.  This  is  a  u  by  2*  Matrix, 
u  being  the  number  of  digits  per  code  word  and  m  being  the  number 
of  Message  bits.  The  Matrix  is  a  square  diagonal  Matrix  of 
size  u  by  u,  the  elements  being 

a^  =  0  far  i  /  k 

=  *kk  &r  i  =  k 

in  which  is  given  by  relation  ( 11)-  5Bie  £  Matrix  is  a  column 
matrix  of  u  rows,  the  elements  being  the  ordered  set  of  eigen¬ 
functions  £q>j(t)}. 

Pbr  communication  systens  with  variable  interference  con¬ 
ditions  and  an  available  feedback  loop,  sophisticated  techniques 
can  be  used  such  as  variable  coding  schemes.  5br  example,  the 
noise  conditions  in  the  channel  can  be  estimated  at  the  receiver 
and  from  these  estimates  the  best  code  picked  from  the  set  of 
available  codes.  The  transmitter  is  informed  through  the  feed¬ 
back  channel  to  correspondingly  change  the  transmission  and  the 
receiver  is  adjusted  to  receive  the  new  alphabet.  Thus,  an 


adaptive  feature  la  Incorporated  Into  the  ays  tea  vlth  considerable 
improvement  In  the  performance  of  the  conn  1  cat  Ion  system.  At 
the  other  range  of  poaalbUltlea  there  la  the  ainple  discarding 
dec  ia  ion  feedback  technique*  which  hare  already-  been  shown  to  be 
effective. 

B.  Implementation  of  the  Uncertainty- Region- Be  cept  ion 

Receiver _ 

To  simplify  the  instrumentation  of  the  uncertainty- region- 
reception  receiver.  It  la  dealrable  to  employ  orthogonal  digit 
code*  with  matrix  CL  of  equation  (86)  chosen  to  be  a  binary-  group 

1l 

code  vlth  all  xeroa  replaced  by  minus  ones.  In  group  codes  the 
distance  In  digits  between  aiy  two  code  words  la  the  same  as  the 
weight  of  the  code  word  (number  of  one*  In  the  code  word)  obtained 
by  addition  modulo  two  of  the  original  two  words.  But  since  group 
codes  are  such  that  the  addition  modulo  two  of  any  two  code  words 
Is  another  code  word,  the  distance  In  digits  between  any  two  code 
words  Is  the  same  as  the  weight  of  another  code  word.  If  one  of 
the  code  words  la  the  Identity  word,  the  distance  In  digits  Is  the 
weight  of  that  one  of  the  two  code  words  which  Is  not  the  Identity. 
Jbr  any  particular  code  word  the  set  of  distances  In  digits  of 
that  code  word  from  each  of  the  other  code  words  Is  thus  the  same 
as  the  set  of  weights  of  each  code  word. 

Using  the  properties  of  group  alphabets,  one  can  replace 


^9 


the  decision  process  at  the  receiver  "by  the  following  equivalent 
operation.  Eliminate  the  Identity  signal  from  the  signalling  set, 
[s^(t)j,  and  form  for  the  remaining  2°-!  signals  the  sums 


y V*. 


lk 


k=l  °k 


(8?) 


In  which  the  summation  Is  performed  only  over  the  positive  orthogonal 
digits  of  each  signal.  The  Simplified  equivalent  receiver  prints 
the  signal  s^(t)  corresponding  to  the  largest  exceeding  the 
threshold  level,  kj/2-  If  none  of  the  sums,  S.,  exceeds  the  thresh¬ 
old  level,  a  null  la  printed  which  may  he  removed  by  retransmis¬ 
sion  requested  through  the  feedback  channel. 

®ie  receiver  can  form  the  set  of  levels  {S^}  by  ctosb- 
correlating  the  set  t-SP-  cpk(t)}  with  y(t)  far  all  k  =  1,2,3,  ..., 
uf  the  crosscorrelators  are  followed  by  sign  inverters  and  (z* -l) 
accumulators.  The  outputs  of  the  accumulators  are  the  desirable 
set  {S±}.  The  suggested  receiver  circuit  requires  only  u  corre¬ 
lation*.  Jbr  Instance,  for  mini  max  codes  (2s-!)  are  replaced  by  m 
correlations.  The  receiver  nay  also  be  implemented  using  a  bank 
of  matched  filters.  Consider  the  set  of  functions,  {gj(t)J,  de¬ 
fined  by 

e±(t)  -  l 


*ik 


* k(t) 


k=l 


<4 


(88) 
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In  which  smatlon  is  to  he  taken  over  positive  digits  only.  Thus, 
to  each  s^t)  corresponds  a  specific  gjCt).  Equation  (87)  can  then 
he  replaced  by 

T 

B±  =  ^(tJjKt)  dt  ,  0  <  t  <  f  (89) 

0 

If  a  new  set  of  functions  is  defined  by 

h1(f-t)  =  g^t)  (90) 

one  can  interpret  equation  (89)  as  representing  linear  filtering 
of  y(t)  using  filters  with  Impulsive  responses  h^(t).  Thus, 
alternately  the  set  of  detected  lerels  {S^}  necessary  for  the 
decision  at  the  receiver  can  be  obtained  using  a  bank  of  linear 
filters. 
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YL  GEOMETRIC  HfPERPREPATIOR  OP  UHCEHTA32ITT  REGION  HECEPKOR 

Consider  a  it- dimensional  system  o f  rectangular  coordinates.* 
Corresponding  to  each  pair  of  signals such  as  s^(t),  Sj(t),  define 
a  fixed  vector  A  the  projections  of  'which  on  the  coordinate 
vectors  are  of  length 

alk  "  ajk  , 

^  JL  —  J-j  Ctf  O  0  m  •  f  U. 

4 

Corresponding  to  each  received  signal,  y(t),  define  a  vector  T  such 
that  the  projections  of  the  Y-vector  on  the  coordinate  vectors  are 
of  length  y^y^  'being  the  coefficient  of  the  orthogonal  series 
expansion  of  y(t).  Jbrm  the  dot  products 

(AiyY)  (91) 

for  all  pairs  of  signals.  If  the  dot  product  exceeds  the  uncertainty 
parameter  kx,  s^(t)  Is  more  likely  the  signal  sent  than  Sj(t).  If 
the  also  lute  value  of  the  dot  product  Is  less  than  kj,  no  decision 
Is  made.  If  the  dot  product  Is  less  than  k^,  s^(t)  is  less  likely 
the  signal  sent  than  s^(t). 

The  set  of  Inequalities  corresponding  to  the  uncertainty 
region  reception  decision  rules  can  he  Interpreted  as  follows. 

For  any  pair  of  signals  s^(t)  and  s^(t)  of  the  transmlttlble  set. 


*  Ihe  u- dimensional  Euclidean  space 
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the  u-dimensional  space  Is  divided  Into  three  distinct  regions 
by  two  parallel  (u-l) -dimensional  hyperplanes  normal  to  the 
vector  Ay  The  two  hyperplanes  are  defined  by  equations 


jf 

II 

H 

•v 

(92) 

(A±yT)  =  -  ki 

(93) 

respectively.  The  region  between  the  two  hyperplanes  Is  the 
region  of  withheld  decision.  The  region  located  on  the  far  side 
of  the  hyperplane  looking  from  the  origin  in  the  direction  of  orien¬ 
tation  of  the  vector  Is  the  region  of  acceptance  far  signal 
s^t).  The  region  located  on  the  fhr  side  of  the  hyperplane  looking 
from  the  origin  In  the  direction  opposite  to  the  orientation  of 

the  vector  A,,  is  the  region  of  acceptance  for  signal  s  (t). 

J  2*  J 
Repeating  the  shore  procedure  for  the  ( g  )  possible  pairs  of  sig¬ 
nals  of  the  transmlttlble  set,  the  generated  hyperplanea  will 
enclose  a  polytope  in  the  n- dimensional  space.  The  interior  of 
the  polytope  Is  the  uncertainty  region.  To  find  the  distances 
from  the  origin  to  the  hyperplanes  of  the  polytope  one  can  use 
two  methods:  one  Is  a  direct  extension  of  the  geometrical  analysis 
used  In  three  dimensional  spacers  to  the  multidimensional  space, 
the  second  one  uses  Lagrange's  method  of  Indeterminate  multipliers. 
This  latter  technique  is  used  In  -Appendix  B.  The  distance  from. 
the  origin  to  the  hyperplane  corresponding  to  signals  s1(t),Sj(t) 
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is  found  to  be 


*1 

j-y  jaafcSjfc)  y 
k=i  o*  J 


(9k) 


The  distances  between  the  corresponding  tvo  parallel  hype rp lanes 
at  the  uncertainty-region  boundaries  Is  2  d^j. 

For  orthogonal  digit  codes  the  distance  from  the  origin 
to  the  hyperplane  reduces  to 


(95) 


In  which  fi  ^  iB  *ew>  if  the  signs  of  the  corresponding  orthogonal 
digits  aflryRjV  are  the  same  and  unity  If  the  signs  differ. 


u 


k  =  I  6ijk 

k=l 


(96) 


as  before. 

Ibr  the  mini mar  code,  u  =  a  and  X.  ranges  from  1  to  a 
For  the  equal  separation  code,  u  =  2* -1,  and  X  Is  2*”^  for  all 
pairs  of  signals.  In  this  case 


5^ 


Note  that  the  members  of  the  set  of  variances,  {o^},  are  not  all 
equal,  hut  depend  on  the  pair  of  signals  being  considered.  Thus, 
for  the  equal  separation  code,  though  all  the  separations  are  equal, 
the  distances  to  the  hype rp lanes  enclosing  the  polytope  of  the  un¬ 
certainty  region  are  unequal.  Equality  can  he  achieved  only  by 
varying  the  uncertainty  parameter  kj  -with  the  resulting  complica¬ 
tions  In  the  processing  of  signals  at  the  receiver,  tor  the  equi¬ 
distant  code  not  only  are  the  separation  functions  equal  hut  also 
the  distances  to  the  hyperplanes  enclosing  the  polytope  of  the 
uncertainty  region  are  equal.  The  expression  for  the  distance,  d^, 
reduces  In  this  case  to 


(98) 


In  which  -rf  Is  the  lowest  eigenvalue  corresponding  to  a  signal 
duration  t/e*-!- 

The  processing  of  the  signals  at  the  receiver  can  he  Inter¬ 
preted  In  tens  of  the  geometric  model  as  follows.  If  the  tip  of 
the  received  vector  7  falls  inside  the  uncertainty  region  polytope. 
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a  wu~n  decision  la  made.  !Hiis  decision  could  later  be  replaced 
by  Information  received  by  repetition  requested  by  means  of  a  feed¬ 
back  channel.  If  the  tip  of  the  received  vector  T  falls  outside 
the  uncertainty  region  polytope,  the  signal  corresponding  to  the 
largest  distance  of  Its  hyperplane  to  the  tip  of  vector  T  Is  con¬ 
sidered  the  most  likely  signal  sent. 
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AFPHTDU  A 

Background:  Detection  of  Signals  In  Colored  jjolse 

In  &  broad  sen me,  a  receiver  lm  a  counter  —  albeit  In 
■any  cases  a  fairly  staple  analog  computer.  From  the  Incoming 
signal,  y(t),  the  receiver  calculates  vhich  of  the  possible  trans¬ 
mitted  signals  {»i(t)}  Is  most  likely  the  signal  sent.  Ibrmally, 
the  receiver  may  be  considered  to  evaluate  the  a  posteriori  proba¬ 
bilities  [p[y(t)/si(t)  ]}  for  each  possible  transmitted  signal. 
Single-valued  functions  of  these  a  posteriori  probabilities  may 
actually  be  present  In  the  receiver  as  voltage  levels.  Bar  com¬ 
pletely  automatic  operation  these  voltage  levels  are  compared 
vith  preset  thresholds  or  each  other  as  a  means  of  deciding  the 
most  likely  signal  sent.  Alternatively,  the  voltage  levels  can  be 
presented  to  an  operator  for  final  decision.  The  choice  of  the 
preset  threshold  levels  depends  on  a  priori  signal  probabilities, 
relative  costs  of  making  errors,  and  value  Judgements.  Bor 
example,  threshold  levels  can  be  used  vhich  correspond  to  mini mam 
error  probability. 

When  the  noise  Is  additive,  the  conditional  probabilities 
{pty(t)/s1(t)]}  are  staply  the  probabilities  that  interference  had 
the  vaveforms  (n^(t) }  In  vhich 

njCt)  -  y(t)  -  »!(*) 


The  sort  likely  Interference  vaveform  corresponds  to  the  aost 
likely  signal.  To  determine  the  aost  likely  Interference  wave¬ 
form,  the  possible  signals  and  the  received  signal  are  saapled  at 
Instants  of  tine  t  apart  such  that  there  are  H  saaples  of  the 
signal  duration  T.  The  channel  Is  considered  distortionless  so 
that  the  k=-  sample  of  the  transaltted  signal  causes  the 
sample  of  the  received  signal.  If  s^  Is  the  value  of  s^(t)  at 
t  =  kt^  and  y^  Is  the  value  of  y(t)  at  t  =  kt^,  then 


pfcKtJ/a^t)]  =  Lla  p[ytl,ytz. 


11' *12' 


Uf 


] 


Is  the  sane  as  expecting  the  Interference  to  have  the  saapled 
values 


*11  =  ytl  ”  *11 
*12  =  yt2  "  *12 
nlH  =  ytH  "  *111 


Kote  that  this  procedure  Is  satisfactory  If  the  total 
noise  power  Is  finite.  If  the  total  noise  power  Is  not  finite, 
the  "saaples”  become  the  Integrated  values  of  the  signals  over 
each  duration  t^»  Alternatively,  the  noise  power  spectrum  can 
he  truncated  at  sone  high  frequency  f  and  then  as  t^  — >■  0, 
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When  the  interference  is  -white  gauss  Ian  noise  the  sailed 
rallies  of  the  Interference  are  independent  and.  the  analysis  Is 
simplified.  In  this  case  the  Joint  probability  density  that  the 
sampled  rallies  of  the  noise  are  n^n^,  ...  n^  ...  can  he 
written  as  the  product  of  the  lndirldual  or  marginal  probabilities. 
Thus 

p(nii,n12,  ...  na)  =  P(»n)p(\2)  •*'  PUt,) 

in  which 


p(n) 


1  e-na/20af 
j'z-xC?  f 


since  p(n)  has  a  gaussian  distribution  and  the  noise  power  per 
unit  bandwidth  is  O3.  The  remainder  of  the  procedure  for  deter¬ 
mining  the  optimum  receiver  Is  straight  forward.  Bote  that 


p(a. 


Il'ni2' 


“iH5  = 


1  e-V2^f 


V2*o“fS 


N 

L 

k=l 


4 


is  such  that  the  ralues  of  the  noise  sables  appear  only  in  the 
exponent 


JL _ 

20af 


R 


k=l 
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Uhls  exponent  correspond*  to 


1 

a^f 


K 


Z  ^7tk  ”  *lk^ 

k=l 


a 


or  in  the  Unit,  a*  t^=  -y 


0,  to 


T 

[y(t)  -  s^t)]3  dt 

0 


In  which  T  Is  the  duration  of  the  signals. 
If  the  tens  are  Multiplied  out 


T 


J*(t)dt 


T 


2 


yCtJs^tJdt  + 


0 


T 

B^(t)dt] 

V 

0 


and  the  first  term  Is  discarded  as  being  comson  to  all  signals, 
while  the  last  term  Is  discarded  since  the  -value  Is  known  before 
any  signal  has  been  received.  The  result  (eliminating  the  scale 
factor  1/ct3) 

T 

y(t)sj,(t)dt 

c 

0 


gives  the  quantities  the  receiver  should  compute  for  each  received 


signal. 
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letting  f^(t)  =  s^(t)  the  result  Is  that  for  optima 
detection  the  received,  signal  y(t)  should,  he  correlated  with  each 
fj(t)  and  the  outputs  of  the  correlators  (or  the  equivalent)  he 
used  to  decide  which  signal  was  sent.  For  the  case  In  which  the 
interference  Is  white  noise,  f^(t)  Is  the  saae  as  the  corresponding 
signal  s1(t).  As  will  he  seen,  for  the  colored  noise  case  the 
optimum  receiver  Is  similar,  hut  f  (t)  will  not  only  the 

signal  structure,  hut  the  noise  structure  as  well. 

When  the  Interference  is  colored  noise  the  Joint  proba¬ 
bility  ***  njjj)  canno*  1*  "written  as  the  product  of 

the  marginal  probability  p(n)  because  the  noise  Is  no  longer  In¬ 
dependent  from  one  sample  to  another.  The  fact  that  the  noise 
Is  gausslan  can  he  directly  applied  by  using  the  order  Joint 
gausslan  distribution.  The  procedure  Is  algebraically  aoaplex 
hut  the  difficulties  are  not  Insurmountable.  Ito  reduce  this 
plexLty  matrix  notation  will  he  used. 

The  Joint  gausslan  distribution  is  not  readily  written 
In  terms  of  the  corresponding  power  density  spectrum,  hut  rather 
In  terms  of  the  autocorrelation  function.  Let  B(t)  he  the  auto¬ 
correlation  function  of  the  noise  —  1.  e.,  the  Iburier  transform 
of  the  noise  power  density  spectrum.  Let  R  be  the  mtrlx 


6i 


R  = 


*L1 

*L2 

R21 

R22 

• 

• 

% 

• 

*A). 

Let  X 

“ur 


Ml  '  A 
joint  noise  distribution  is  given  by 


p(nH>n12,  ...  nu)  - 


(2<)^21X|V2 


H  1 

e3cp{-  T  II  Xm?i,n 

=1  n=l 


In  vhich  Jx  l  1b  the  determinant  corresponding  to  X. 

If,  as  for  the  case  In  vhich  the  Interference  vas  addl 
tire  vhlte  noise.  It  Is  noted  that  the  probability  Is  single- 
valued  dependent  on  the  exponent.  It  follows  that  the  receiver 
need  only  evaluate 

H  N 

-  4-  I  1  W'iV'ta ror  “ch  *• 

»=1  n=l 


Since  the  noise  Is  additive,  this  Is  the  sane  as 


H  R 

X  X  ^an^t*  ~  "lm^^tn  ”  flln^ 


sf=1  n=l 


or 
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5  5 


2  X  ^mn^tsf^tn  ”  ytm*in  -  ytn8la.  +  BlmS  in^ 

®=1  n=l 


The  first  term  Is  independent  of  the  signal,  s^(t),  and  can  thus 
he  discarded.  The  last  term  is  a  priori  known  before  any  signal 
has  been  received.  It  can  therefore  be  included  in  the  decision 
thresholds  and  need  not  be  recalculated  each  tine  a  signal  is  re¬ 
ceived.  In  addition,  Xm  "  Xnm*  and  thus 

If  H  H  H 

X  X  Smi^tm8in  X  X  Xmnytn8im 

m=l  n=l  *=1  n=l 

Hence  the  receiver  need  only  compute  the  test  statistics 
H  H 

I  I  X-rt.'la  tor  “ch  1 

a=l  n=l 


By  letting 


im 


IT 


y  x  s4 

L.  mn  in 
n=l 


the  test  statistics  become 


I  fi^m 


eras  tA 


0,  H  — ►  oo 
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T 

% 

dt 

0 

The  result  for  colored  noise  Is  similar  to  that  obtained,  for  vhlte 
noise  —  namely,  that  correlation  detection  is  optimum.  Instead 
of  the  locally  generated  signals  at  the  receiver  being  the  same  as 
the  signals  sent 

ft(t)  =  s^t)  far  each  1  , 

It  Is  determined  from  the  sampled  values 

X 

=  X  Xmn*in 
n=l 

To  determine  a  more  suitable  relation  for  f^(t)  note  that 
the  above  expression  represents  a  set  of  linear  algebraic  equa¬ 
tions  for  [f13/f12/  in  terms  of  [s^s^  ...  sffl]. 

Solving  this  set  of  equations  for  the  sampled  values  of  S^(t) 
gives 

X 

=  y  r _ f. 

In  L,  nm  lm 
m=l 

or  In  the  Halt  as  t^  — >  0,  X  — >■  oo. 


6k 

T 

■> 

*1(t)  =  R(t-r)  f^r)  dT 

X. 

0 

In  which  the  ■ asp led  value*  of  f^(r)  are  proportional  to  the 
samples  f^.  This  is  the  haslc  equation  from  which  f^(t)  la  deter¬ 
mined.  As  an  e-nurple,  when  the  noise  is  white,  R(t)  is  a  delta 
function 

R(t)  =  Zff&ix) 

Thus 

M±(t)  =  Zft^t) 
or,  neglecting  the  scale  factor 
f±(t)  =  s^t) 

So  design  an  optimum  receiver  it  is  necessary  to  solve 
the  integral  equation 

T 

> 

^(■b)  =  RCt-T)  fjCf)  dT 
0 

for  the  waveforms  f^(t).  Once  these  waveforms  are  known  the  re¬ 
ceived  signal  is  correlated  (or  an  equivalent  operation  is  per¬ 
formed)  with  each  f^(t)  and  the  outputs  of  the  correlators  are 
compared. 
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So  determine  f^(t),  a  procedure  can  be  uaed  which  is 
similar  to  that  used  In  solving  ordinary  differential  equations. 
Die  homogeneous  Integral  equation 


T 


0»cp(t)  = 


B(t--r)  <p(f)  dr 


0 


is  solved  for  first.  Shis  equation  has  the  trivial  solution 

cp(t)  =  0.  It  also  has  nontrivial  solutions  for  certain  definite 
a  a 

values  of  a.  Bach  value  of  a  for  which  there  Is  a  nontrivial  solu¬ 
tion  Is  called  an  eigenvalue,  and  the  corresponding  function  cp(t) 

Is  called  an  eigenfunction. 

The  solutions  have  the  same  character  as  those  of  an 
ordinary  differential  equation  plus  boundary  conditions.  Jbr 
example,  consider  the  ordinary  differential  equation 


+  <i?y(t)  »  0 
dta 

This  has  the  trivial  solution  y{t)  =  0.  It  has  the  general  non¬ 
trivial  solution 


y(t)  =  A  cos  aSfc  +  B  sin  ait 

In  which  A  and  B  are  arbitrary,  and  <d  can  be  any  constant.  If, 
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however,  ve  impose  the  boundary  conditions 

7(0)  =  0 

arU)  =  0 

then  the  solution  becomes 

y(t)  =  B  sin  xut 

Thus,  only  If  the  constant  m  equals  *n  far  n  =  0,+l,+2,  ...  Is 
there  a  nontrivial  solution  to  the  differential  equation  which 
also  satisfies  the  boundary  conditions.  These  values  of  co  for 
which  a  nontrivial  solution  exists  are  called  eigenvalues  and  the 
corresponding  functions  are  called  eigenfunctions. 

A  homogeneous  ordinary  differential  equation  with  boundary 
conditions  can  be  converted  to  an  Integral  equation.  Ibr  example, 
consider  the  above  differential  equation  with  the  boundary  condi¬ 
tions.  This  corresponds  to  the  Integral  equation 


T 

a^y(t)  = 

A 

0 


l(t,T)  y(r)  dr 


In  which  K(t,x),  the  kernel.  Is 

K(t,r)  *  (l  -  t)r  °<T<t<l 

=  t(l  -  t)  0  <  t  <  t  <  1 
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Because  of  the  relation  "between  integral  and  differential  equa^ 
tions,  one  valuable  technique  for  solving  integral  equation*  1* 
to  determine  the  corresponding  differential  equation. 

This  correspondence  suggests,  as  is  true,  that  the  solu¬ 
tions  to  the  homogeneous  Integral  equation  are  orthogonal,  fbr 
convenience,  consider  the  solution  corresponding  to  the  lowest 
value  of  aa  to  "be  the  first  eigenfunction,  the  next  lowest,  the 
second  eigenfunction,  and  so  on.  The  orthogonal  property  sates 
it  easy  to  expand  the  signal  vaveforss  in  terms  of  these  func¬ 
tions.  Letting 

oo 

*i(t)  "  1  Cn*n(t) 
n=l 

since  the  (cpn(t)}  are  orthogonal 

T 

J  SjCtJcp^t)  dt 


J  cpj(t)  dt 


0 

If  the  eigenfunctions  are  normalized  so  that 

T 

J  <P*(t)  dt  =  1 

0 


for  all  n 
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then 


C 


n 


T 

•i(t)cpn(t)  dt 

0 


So  soIts  the  Integral  equation 


T 


J  RCt-Tj^Cr)  dr 
0 


s1(t)  Is  expanded  using  this  orthogonal  set 


•Jit) 


+S12'P2^t^  +  ***  +  Slktp k^  + 


In  which 


S 


lk 


f 

* 

*i(t)<pk(t)  at 

w 

0 


and  a  series  solution  is  sought  for  f^(t)  of  the  form 


fi<t)  -  i^ft)  +  »12f2(t) 


+  y 


lk' 


?v(t> 


Hie  it—  coefficient  of  thin  expansion,  F,  .  can  be  lbund 
hy  multiplying  "both  sides  of  the  Integral  equation  hy  cpk(t)  and 
then  Integrating  from  0  to  T  with  respect  to  T.  The  result  Is 
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Bra* 


^(t) 


oo 


-  I 

fe=l 


One  method  of  correlating  the  received  signal  y(t)  vith  f  (t)  1* 
Shown  in  Figure  A-l.  Kadi  voltage  divider  1*  set  to  correspond 
to  a  coefficient  of  the  expansion  —  i.e. ,  the  k^  divider  corre¬ 
spond s  to  the  factor  8^/g^.  Since  a*  is  greater  for  Larger  values 
of  k,  the  contribution  to  the  sum  for  large  k  is  usually  snail. 

Bras  a  near  optimal  practical  system  need  not  require  a  great  msay 
correlators  and  dividers. 

Another  Important  point  to  note  that  the  k^  component 
of  the  output  sun  is  proportional  to 


T 


I 

r» 


•±(t)cpk(t)  dt  + 


o 


n(t)tpk(t)  dt 


0  0 

The  first  torn  is  the  nean  output,  the  second  the  effect  of  the 
noise.  Since  n(t)  is  gaussian,  the  noise  present  in  each  compo¬ 
nent  of  the  output  sum,  and;  hence  in  the  sun  Itself,  is  also 
gausslan.  Moreover,  the  noise  present  in  each  component  Is  inde¬ 
pendent  of  the  noise  in  soy  of  the  other  components  —  i.  e. ,  the 
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FIG.  A-! 

ONE  DIRECT  TECHNIQUE  FOR  COR¬ 
RELATING  THE  RECEIVED  SIGNAL 
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cross-correlation  la  zero. 


n(t)<pj(t)  dt 


h(tW(t)  dr  > 


0 

T  T 


<  n(t)n(r)  >  <f>j(t)cpk(T)  dtdr 


u 

0  0 


T  T 


R(t-T)opj(t)<pk(T)  dtdr 


0  0 
T 


9j(t)  dt  R(t~T)«pk(T)  dx 


«J 

0 


=  cr. 


<Pj(t)<pk(t)  dt 


=  0 


To  gain  further  Insight  Into  the  problem  of  detecting  sig¬ 
nals  In  colored  noise,  consider  the  problem  Independently  of  the 
prerlous  analysis.  In  the  previous  approach  the  likelihood  ratio 
vas  based  on  the  values  attained  by  the  received  signal  y(t)  at 

Intervals  tA  apart.  The  fact  that  the  noise  vas  correlated  led 
A 
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to  difficulties  because  the  no  lee  at  these  sailed  tines  were  not 
Independent. 

One  useful  suggestion.  Is  to  find  a  set  of  observable 
coordinates  y^  that  are  uncorrelated  hot  can  he  generated  free  the 
received  signal  y(t)  by  linear  operations.  This  corresponds  to 
the  general  type  of  receiver  Aon  In  Rgure  ir-2.  Tb  determine 
the  linear  circuits,  note  that  se  desire  to  have 

rft) -£  j-kyt> 

k 

In  ¥hlcfa,  for  convenience,  the  set  ®k(t)  Is  crtbonoraal  vith  re¬ 
spect  to  the  Interval  0  <  t<  T.  this  permits  the  coordinates 
(or  coefficients)  y^  to  be  computed  Tram. 

T 

> 

3rk  =  *k(t)y(t)  dt 

V 

0 

She  functions  {®k(t)J,  however,  have  exactly  the  sane  properties 
as  the  orthogonal  set  {«Pk(t)}, 

®k(t)  =  «Pk(t) 

This  approach  thus  leads  to  the  sane  result  as  that  based 
on  directly  observing  the  received  signal.  Bote  that  the  linear 
circuits  of  the  optlxue  receiver  can  be  natebed  filters  in  'which 
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the  lagpolslve  responses  mi*  Matched  to  (f^Ct)}.  Oils  is  analogous 
to  the  ease  In  -which  the  noise  is  white  and  the  filters  are  Matched 
to  (s^(t)}.  lhe  circuit  shown  In  Figure  A-l  is  simply  one  way 
of  synthesising  the  Batched  filters. 


APPENDIX  B 


Distance*  from  the  Origin  of  the  u-dlmenslonal  Subspace 
to  the  Hyperplanes  of  the  Uncertainty  Beglon  Polytope 


Consider  the  u-dijsensional  -rector  T  specified  by  Its  u 
orthogonal  projections  (yi,y8,  . yu)*  Phis  vector  starts  at 
the  origin  and  terminates  on  the  surface  of  the  hyperplane 


kj  -  (A^T)  (B-l) 

Thus,  determination  of  the  distance  from  the  origin  to  the  hyper- 
plane  defined  by  equation  (B-l)  reduces  to  minimization  of  the 
length  of  vector  T 

Htx*73*  •••>  yu) -JU  (B-2) 

k=l 

subject  to  the  constraint  expressed  by 


(B-3) 


Equation  (B-3)  corresponds  to  equation  (B-l)  with  the  dot  product 
of  the  two  vectors  expressed  in  terms  of  their  orthogonal  projections. 
Using  Lagrange's  method  of  multipliers,  the  minimization  of  L(y1,ya, 

,  y  )  is  desired  subject  to  the  condition 
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This  reduces  to  the  solution  of  (utf-l)  equations 

Sf 


si 

arx 

ai 

ays 


+  Xi- 

+  xx- 


ayi 

af 

ay8 


=  0 


=  0 


tr +  =  0 


(B-5) 


ai. 


+  Xx- 


af 


3^11  Syu 

and  =  Xx 


(B-6) 


In  which  the  set  {y  }  1b  now  the  set  of  solutlonal  values  and  Xx 

A 

Is  the  undetermined  Multiplier.  Consider  a  typical  term,  y^  then 


and 


8L 

ayk 


af 


¥ 


*lk  ~  ajk 


(B-7) 


(B-8) 


Using  equations  (B-5)/  (B-7)/  and  (B-8)/  we  obtain 
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7X 

JU 


05 


k=l 


^(&lk-aJk) 


(B-9) 


k=l 


Xl(alu"*Ju) 


Multiplying  T9oth  aides  of  equations  (B-9)  by  JuTa*  -  *  - ^y^  *  •  -y^j 
sinadng  'both  sides  it  is  found  that 


k-1 


-  X*kx 


(B-10) 


Similarly  squaring  "both  sides  of  equations  (B-9) *  suadng  both, 
sides,  ve  obtain 

i .  *  i  faa£.  .  (B-n, 

k=l  ak 

■  / 

From  equations  (B-10)  and  (B-ll)  it  Ibllows  that 
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a 

k»l 


(alk~ajk->a  ^ 


(B-12) 


fill*  result  could  hare  been  obtained  using  &  geomtrlc  ■rthod. 

She  distance  from  the  origin  to  the  hyperplane  defined  by  equation 
(B~3)  is  the  length  of  the  projection  of  Teeter  T  on  the  Teeter 
Ay.  This  is  true  because  both  Teeters  terminate  on  the  hyperplane 
and  the  Teeter  Is  noxml  to  the  hyperplane.  Thus,  the  distance 


yi 

11  «VV]t 


(*-13) 


Using  equation  (B-3)  and  the  analytic  expression  for  (A^yA^), 
equation  (B-13)  reduces  to  equation  (B-12). 
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The  Research  Division  of  the  College  of  Engineering  is  an  integral  part  of  the  educational 
program  of  the  College.  The  faculty  of  the  College  takes  part  in  the  work  of  the  Research  Divi¬ 
sion,  often  serving  as  co-ordinators  or  project  directors  or  as  technical  specialists  on  the  projects. 

This  research  activity  enriches  the  educational  experience  of  their  students  since  it  enables  the 
faculty  to  be  practicing  scientists  and  engineers,  in  close  touch  with  developments  and  current 
problems  in  their  field  of  specialization.  At  the  same  time,  this  arrangement  makes  available  to 
industrial  and  governmental  sponsors  the  wealth  of  experience  and  special  training  represented  by 
the  faculty  of  a  major  engineering  college.  The  staff  of  the  Division  is  drawn  from  many  areas  of 
engineering  and  research.  It  includes  men  formerly  with  the  research  divisions  of  industry,  govern¬ 
mental  and  public  agencies,  and  independent  research  organizations. 

Following  are  the  areas  represented  in  the  research  program:  Aeronautical  Engineering, 
Chemical  Engineering,  Civil  Engineering,  Electrical  Engineering,  Engineering  Mechanics,  Indus¬ 
trial  and  Management  Engineering,  Mechanical  Engineering,  Metallurgical  Engineering,  Mathe¬ 
matics,  Meteorology  and  Oceanography,  and  Physics.  In  addition,  an  interdisciplinary  research 
group  is  responsible  for  studies  which  embrace  several  disciplines.  Inquiries  regarding  specific 
areas  of  research  may  be  addressed  to  the  Director,  Research  Division  for  forwarding  to  the  appropriate 
research  group. 


